Pattern Based Graph Generator 



Hong-Han Shuai De-Nian Yang 

National Taiwan Univ. Academia Sinica 

d99942020@ntu.edu.tw dnyang@iis.sinica.edu.tw 

Philip S. Yu Chih-Ya Shen Ming-Syan Chen 

Univ. of Illinois at Chicago National Taiwan Univ. National Taiwan Univ. 

psyu@cs.uic.edu d96921017@ntu.edu.tw mschen@cc.ee.ntu.edu.tw 



ABSTRACT 

The importance of graph mining has been widely recognized thanks 
to a large variety of applications in many areas, while real datasets 
always play important roles to examine the solution quality and ef- 
ficiency of a graph mining algorithm. Nevertheless, the size of a 
real dataset is usually fixed and constrained according to the avail- 
able resources, such as the efforts to crawl an on-line social net- 
work. In this case, employing a synthetic graph generator is a pos- 
sible way to generate a massive graph (e.g., billions nodes) for eval- 
uating the scalability of an algorithm, and current popular statistical 
graph generators are properly designed to maintain statistical met- 
rics such as total node degree, degree distribution, diameter, and 
clustering coefficient of the original social graphs. Nevertheless, 
in addition to the above metrics, recent studies on graph mining 
point out that graph frequent patterns are also important to pro- 
vide useful implications for the corresponding social networking 
applications, but this crucial criterion has not been noticed in the 
existing graph generators. This paper first manifests that numer- 
ous graph patterns, especially large patterns that are crucial with 
important domain-specific semantic, unfortunately disappear in the 
graphs created by popular statistic graph generators, even though 
those graphs enjoy the same statistical metrics with the original real 
dataset. To address this important need, we make the first attempt 
to propose a pattern based graph generator (PBGG) to generate a 
graph including all patterns and satisfy the user-specified parame- 
ters on supports, network size, degree distribution, and clustering 
coefficient. Experimental results show that PBGG is efficient and 
able to generate a billion-node graph with about 10 minutes, and 
PBGG is released for free download. 

Categories and Subject Descriptors 

H. 2.8 [Database Management]: Database applications — Data Min- 
ing; H.3.4 [Information Storage and Retrieval]: Systems and 
Software — Information Networks 

General Terms 

Algorithms 

Keywords 

Graph Mining 

I. INTRODUCTION 

Mining of graph data has become increasingly important for a 
variety of applications in chemistry, virology, bioinformatics, so- 
cial networking, etc. For virology, by mining the structure of the 
AIDS antiviral screen data from Developmental Theroapeutics Pro- 
gram in NCI/NIH, it is possible to identify active HIV virus because 
active HIV virus usually reveals some common graph structures in 



which inactive HIV virus does not share. Those common graph 
structures enable virologists to facilitate effective design of the cor- 
responding drugs and vaccine. For bioinformatics, mining frequent 
patterns enables biologists to effectively filter out spurious edges in 
a huge biological network, and mining coherent dense subgraphs 
across massive biological networks can achieve functional discov- 
ery in biology. For sociology, frequent pattern mining can extract 
meaningful connectivity formations in communities. By mining 
the common structure of terrorist-network, the abnormal structure 
can also be employed for terrorist-network detection. 

Real datasets always play crucial roles to evaluate the quality of 
the graph patterns and the efficiency of the proposed mining al- 
gorithms. However, the sizes of many available real datasets are 
usually fixed and constrained, especially in social networks, due 
to privacy issues and the available resources to crawl the corre- 
sponding social networking applications. To test the performance 
of a mining algorithm under different graph sizes, it is possible to 
randomly sample a subset of nodes and edges in a real dataset, but 
important graph characteristics may disappear in the down sampled 
subgraph, undermining the credibility of the results in experiments. 
Similarly, it is even more challenging to generate a larger graph by 
upsampling a real dataset. Without a larger graph that shares the 
same graph characteristics with the real dataset in hand, it is dif- 
ficult to evaluate the true scalability of a graph mining algorithm, 
especially in a cloud environment. 

A possible way to tackle the above issue is employing current 
popular statistical graph generators, which are designed to generate 
a single graph following the required node number and statistical 
parameters. By first analyzing the statistical parameters in a real 
dataset, the same parameters can be inserted into a graph generator 
to create a graph with an arbitrary size. A variety of statistical pa- 
rameters are proposed to describe the graph characteristics, such as 
average path length, degree distribution, diameter, giant component 
size, and clustering coefficient. Among them, degree distribution 
and clustering coefficient have been recognized as crucial statisti- 
cal parameters and appeared in many statistical graph generators 
1 1 6 1 1 20 1 . Barabasi and Albert J5] as well as several other groups 
noticed that in many real-world examples, the number of vertices 
with degree k follows a power-law distribution over a large range. 
The distribution F(k) is proportional to k ' for some constant 7 
independent of the scale of the network. On the other hand, clus- 
tering coefficient is a common measurement of the degree to which 
nodes in a graph tend to cluster together. Evidence suggests that in 
most real-world networks, and in particular social networks, nodes 
are inclined to create tightly knit groups characterized by a rela- 
tively high density of ties. This likelihood tends to be greater than 
the average probability of a tie randomly established between two 
nodes. Therefore, it is envisaged that the degree distribution and 
clustering coefficient are important graph characteristics deserved 
to be preserved in a generated graph. 

However, frequent graph patterns, which have been widely rec- 
ognized as crucial graph characteristics, especially from the per- 
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Figure 1: Percentage of Preserved Frequent Patterns 

spective of computer science, unfortunately are ignored in current 
statistical graph generators. In this paper, we first observe that 
many frequent patterns indeed disappear in the graphs generated 
by popular statistical graph generators. More specifically, we first 
analyze the statistical parameters in real datasets DBLP 1271 and 
Facebook 1241 and then generate the graphs with the same sizes 
and statistical parameters from two popular statistical graph gen- 
erators (ER [6|[7'|, and Latent Space [21]). In FigureQ] for each 
pattern size, we plot the percentage of frequent patterns appearing 
in the real datasets and preserved by popular statistical graph gen- 
erators. Figure [TJ manifests that many frequent patterns disappear 
in the generated graphs. Especially, large frequent patterns, which 
usually include important domain-specific semantic, vanish in all 
generated graphs. Therefore, current popular statistical graph gen- 
erators are not pattern-preserving. 

In this paper, we make the first attempt to design a pattern based 
graph generator (PBGG). The design goal of PBGG is to gener- 
ate a large single unlabelecQ graph with the target node number, 
degree distribution, and clustering coefficient^ More importantly, 
the generated graph is guaranteed to contain the frequent patterns 
with the required supports specified by the user. The number of 
subgraphs isomorphic to each pattern in the generated large graph 
will be no smaller than the required support. Notice that the pat- 
terns and statistic parameters for PBGG input can be learnt from 
real datasets or be assigned by users according to their needs. To 
create a graph larger than a real dataset, a simple approach is to 
directly extract a subgraph containing all patterns with the required 
supports (i.e., each node located in any pattern will be extracted) 
from the real dataset and then attach it with additional nodes and 
edges generated by a statistical graph generator. This simple ap- 
proach has the following drawbacks. (1) Apparently, the user is 
prohibited to specify a graph size smaller than the size of the ex- 
tracted subgraph. (2) The user is not allowed to specify an arbitrary 
support. If the target support is twice of the original support, it is 
possible to duplicate the extracted subgraph and then attach addi- 
tional nodes and edges, but this duplication-based strategy cannot 
achieve the supports arbitrarily specified by the user. Similarly, the 
user cannot request new graph patterns. (3) The user is not allowed 
to specify any degree distribution and clustering coefficient. Unless 
the extracted subgraph is modified, any generated graph may fail 
to achieve the degree distribution and clustering coefficient. For 
example, the degree distribution cannot be followed if the num- 
ber of high-degree nodes already exceeds the ones allowed in the 
target degree distribution. (4) Most importantly, no existing statis- 
tical graph generator has the ability to generate a graph from the 



1 It is important to generate a labeled graph for applications such as 
chemistry. In this paper, our first attempt considers graph patterns 
and graph statistics, and the generation of labeled graphs in PBGG 
will be our future work. 

2 PBGG can be extended to generate a large graph database includ- 
ing multiple graphs, where the support of a pattern here is defined 
as the number of graph with the pattern as a subgraph. Compared 
with creating a large graph, it is simpler for PBGG to generate a 
large database with multiple graphs since each pattern only needs 
to appear once in a generated graph in the database. 



extracted subgraph. Many of the above drawbacks also appear in 
another simple approach that first spreads out all patterns (i.e., not 
overlapping any two patterns) and then adds additional nodes and 
edges. 

Based on the above observations, PBGG is designed based on 
the following innovative ideas. (1) A new data structure, called 
pattern covering graph, is proposed to carefully superimpose the 
graph patterns according to the target support, node number, degree 
distribution, and clustering coefficient. (2) After all patterns are in- 
serted, additional nodes and edges are attached to systematically 
achieve the required degree distribution and clustering coefficient. 
Similar to all statistical graph generators, PBGG sometimes may 
not be able to achieve the exact statistical parameters when the pa- 
rameters are improperly specified by the user. In this case, PBGG 
will generate a graph including all patterns with the required sup- 
port and try to approach the target parameters. The experimental 
results in Section|5]manifest that the difference of the target param- 
eters and measured ones are very close in most cases, the same as 
the current statistical graph generators. The contributions of this 
paper are summarized as follows. 

• We point out that current popular statistical graph generators 
are not pattern-preserving. In light of this important need to 
address both frequent graph patterns and statistical parame- 
ters, we make the first attempt to design a pattern based graph 
generator (PBGG) to generate a graph including all patterns 
and satisfy the required parameters on support, node number, 
degree distribution, and clustering coefficient. 

• PBGG is released for free download [2|. Experimental re- 
sults manifest that PBGG is efficient and able to generate 
a billion-node graph with about 10 minutes and faster than 
the tested popular statistical graph generators with released 
packages. 

The rest of this paper is summarized as follows. Section [2] in- 
troduces the related works on graph mining and statistical graph 
generators and describes the rationale behind the design of PBGG. 
Section [3] and Section [4] explain the details in PBGG, and experi- 
mental results are presented in Section|5] Finally, we conclude this 
paper and describe the future work in Section [6] 



2. PRELIMINARY 
2.1 Related Works 

Frequent patterns have been widely recognized as one of the 
most important graph characteristics in graph data mining and anal- 
y sis [ 1 3 1 [ 1 4 1 . Efficient graph mining algorithms for multiple graphs 
have been extensively studied in 1 18||25|[26|, where the input is a 
graph database D consisting of a large set of graphs, {Gi, G2, 
G n } , and the support of a pattern is the number of graphs in the 
database that contains the pattern. Nowadays, with the explosive 
growth of applications on a single large graph, i.e., D={Gi}, such 
as an on-line social network, transportation network, bio-network, 
and Internet, mining of a single massive graph becomes increas- 
ingly important, where the support of a pattern here represents the 
minimum number of pattern instances necessary to participate in 
the graph. More specifically, MoSS |5] was proposed for min- 
ing complete patterns in a single graph. SUBDUE [8] improved 
the efficiency with approximation and identification of the patterns 
that can compress the original graph by substituting the patterns 
with a single vertex. To boost the scalability, SpiderMine [29| ef- 
fectively mined the top-k largest frequent patterns from a single 
massive graph by unleashing the power of small patterns (spiders). 
Graph mining in the cloud has also been explored in PEGASUS 

ED. 



Graph generators are adopted to create graphs with a variety of 
sizes for simulations and experiments in many applications. Sta- 
tistical graph generators have drawn extensive research interests 
to preserve important statistical parameters. Among them, Erdos- 
Renyi-Gilbert (ER) model |6||7| is one of the most fundamental 
models assuming that edges are allocated independently with a 
fixed probability. Holland et al. | 9 | extended ER model by in- 
corporating the attributes associated with any two nodes for edge 
creation. A variety of statistical parameters are proposed to charac- 
terize graphs, such as average path length, degree distribution, di- 
ameter, giant component size, and clustering coefficient [ 1 6 1 1 20 1 . It 
is worth noting that most generators preserve one or two important 
parameters [7 |[16| since the complexity of considering two many 
parameters is high. Raftery et al. [21] observed that the existence 
of an edge between nodes depends on some individual-specific la- 
tent characteristics represented by a point in a low-dimension space 
and proposed Latent Space Model (LSM) to analyze any generated 
graph. Similar to LSM, the exchangeable graph model provides 
the simplest possible extension of the original random graph model 
by introducing a weak form of dependence among the probabil- 
ity of sampling edges (i.e., exchangeability) from non-observable 
node attributes. Among those statistical parameters, the degree dis- 
tribution and clustering coefficient have been recognized as cru- 
cial statistics 1 15 1| 16||20| deserved to summarize a graph, and the 
clustering coefficient is closely related to the number of triangles 
in a graph. Therefore, a graph generator 01210191 characterizing 
triangles and other small structures, such as stars, has been ex- 
plored. Nevertheless, compared to triangles and other small struc- 
tures, graph patterns usually have large sizes and are more com- 
plicated. Moreover, a pattern is necessary to appear with at least 
the times specified by the support. Therefore, the above statistical 
models are not able to generate a graph with frequent graph patterns 
and preserve statistical parameters simultaneously. 

2.2 Pattern Based Graph Generator 

PBGG includes two phases: Pattern Overlapping Phase and Graph 
Augmentation Phase. The flowchart of PBGG is shown in Figure 
[2] The first phase superimposes the patterns with the required sup- 
ports and generates a preliminary graph_G, while the second phase 
then adds additional nodes and edges to G to meet the requirements 
on the node number, degree distribution, and clustering coefficient. 
For Pattern Overlapping Phase, it is expected that fewer nodes will 
be generated in G by aggressively superimposing more patterns, 
and it is easier for Graph Augmentation Phase to insert more ad- 
ditional nodes with zero degree and add edges to those new nodes 
to achieve the degree distribution and clustering coefficient. Never- 
theless, the dense graph G generated in the first phase may contain 
an unaccepted number of nodes with larger degrees and clustering 
coefficients, so that the second phase never has a chance to gen- 
erate a graph that meet the two parameters. On the other hand, a 
mild overlapping strategy is inclined to generate too many nodes in 
G and thus generates graph with size exceeding the node number 
allowed by a user. To address the above issues, it is desirable for 
Pattern Overlapping Phase to carefully examine the pattern struc- 
tures and parameters specified by the user, so that Graph Augmen- 
tation Phase is able to add additional nodes and edges to achieve 
the parameters specified by the user. 

It is necessary for PBGG to incorporate algorithmic steps to en- 
sure that all patterns are inserted. Similar to statistical graph gener- 
ators, PBGG also involves randomized steps in both phases so that 
the topology of each generated graph will be different but share the 
same graph characteristics. When a user specifies improper statis- 
tical parameters, a statistical graph generator may not be able to 
achieve the target parameters. Similarly, PBGG may fail to achieve 
the exact statistical parameters when the parameters are improperly 
specified by the user. In this case, PBGG will generate a graph in- 
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Figure 2: Flowchart of PBGG 

eluding all patterns with the required support and try to approach 
the target parameters. Moreover, given the same support, it is envis- 
aged that a massive graph is inclined to have more different kinds of 
frequent patterns than a smaller graph. Therefore, it is also possible 
that a massive graph generated from PBGG contains other frequent 
patterns not specified by the user. We discuss the above issues in 
Section[6] 

3. PATTERN OVERLAPPING 
3.1 Concept Description 

Given the patterns with the corresponding supports, the first step 
is to generate a random graph that preserves the frequent patterns. 
One simple and fast approach is to directly spread out all patterns 
to create the graph. However, this approach may fail when a user 
specifies a small node number n. For example, a pattern of size 
50 with support 10 is not able to be distributed separately for con- 
structing a graph with n — 59. In contrast, it is possible to generate 
the above graph by distributing only 1 node separately with support 
10 and superimpose the other 49 nodes of the pattern. In addition 
to overlap the same pattern, it would be a good idea to further re- 
duce the graph size by overlapping different patterns. Neverthe- 
less, when two different patterns are arbitrarily superimposed, the 
degrees of the overlapped nodes will significantly increase, deteri- 
orating the flexibility of Graph Augmentation Phase to generate a 
graph following the required degree distribution or clustering coef- 
ficient. Based on the above observations, it is crucial to carefully 
(1) select the set of patterns to be overlapped and (2) choose the 
set of overlapped nodes between any two patterns, according to the 
parameters inserted by the user. 

Overlapping can be categorized into node overlapping and edge 
overlapping. In node overlapping of two nodes from two patterns, 
all incident edges of the node in each pattern remain, and the degree 
of the overlapped node is the sum of the degrees of the node in the 
two patterns. In contrast, it is encouraged to conduct edge overlap- 
ping, which overlaps an edge and the corresponding two terminal 
nodes, because the increment of the degrees of the two terminal 
nodes is effectively reduced, especially when more incident edges 
of a node are superimposed. It is envisaged that the new graph is 
more inclined to follow the degree distribution and clustering coef- 
ficient specified by the user. 

Figure [3] presents an illustrative example to compare different 
overlapping strategies of two patterns Pi and P2 in Figures|3ja) and 
(b). The first strategy in Figure|3lc) superimposes nodes Vi, V2, and 
V3 in both patterns, while vi, V2, and U3 in Pi are overlapped with 
va, V4, and ^5 in P2 in Figure[3ld). Compared to Figure|3la), the 
degrees and clustering coefficients of V2 and W3 in Figure [3jc) in- 
crease, while the clustering coefficients of v\, V4, and v$ also grow. 
In contrast, the second strategy in Figure |3jd) integrates Pi and P2 
in a more seamless way because only the clustering coefficients of 
V4, and v 5 are changed. 

The computation involved in finding a good overlapping strat- 
egy significantly increases with the following factors: (1) the size 
of each pattern and (2) the number of patterns to be overlapped to- 
gether, due to an enormous number of combinations necessary to be 
carefully examined. It is desirable to find a large common subgraph 
of two patterns to reduce the increment of degrees and clustering 
coefficients during pattern overlapping. Nevertheless, the required 
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Figure 3: Pattern Overlapping by Different Nodes and Edges 
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Figure 4: An Illustrating Example of Pattern Covering Graph 

subgraph isomorphism examination 1291 is computation-intensive 
and will undermine the efficiency of PBGG to generate a massive 
graph. 

On the other hand, since patterns are generated from a real graph, 
a naive method is to directly extract from the real graph every node 
and edge participating in any pattern, and the extracted subgraph 
apparently satisfies the supports required in the original graph. How- 
ever, the extract subgraph is not sufficient when the user specifies 
larger supports. More importantly, the user is allowed to specify 
different network sizes, degree distributions, and clustering coeffi- 
cients. It is difficult to guarantee that the graph generated from the 
extracted graph always satisfies all requirements from the user. 

To generate a massive graph in minimal time and support a di- 
verse range of user specified parameters, we propose to exploit the 
relation of pattern covering, which is usually a by-product widely 
available from many graph mining algorithms [5 1[8 1[29 1 during the 
process of pattern generation. A pattern Pi is covered by another 
one Pj if Pi is a subgraph of Pj . For instance, the pattern in Fig- 
ure[5Jb) is covered by the pattern in Figure|5Ia). By leveraging the 
information of pattern covering, PBGG can avoid distributing an 
unnecessary number, i.e., support SU P(Pj), of pattern Pi after all 
the SUP(Pj) patterns are spread out in the graph. More impor- 
tantly, when Pi is covered by both Pj and Pk, it is expected that 
an efficient and effective strategy to superimpose Pj and Pk is to 
overlap the common subgraph Pi of them, because three patterns 
are handled accordingly. Let size„(Pi) and size e (Pi) denote the 
number of nodes and edges in pattern Pi, respectively. The infor- 
mation required in PBGG for pattern overlapping is summarized in 
the following pattern covering graph. 

DEFINITION 1. Pattern covering graph Gp = (U, V, Ep) is a 
balanced bipartite graph, where each node m £ U and Vj 6 V 
correspond to pattern Pi and Pj, respectively. An edge etj£ Ep 
connects m andvj if Pi covers Pj, andwij associated with eij is 
the number of subgraphs in Pi isomorphic to Pj. 

In other words, Wij represents the number of Pj pattern in- 
stances in Pi (i.e., the number of times that Pj appears in Pi). Also, 
the locations of the Wi.j pattern instances of Pj in Pi are stored. 
Let np denote the number of patterns specified by the user. With- 
out loss of generality, the patterns Pi, P%, ...,P np are numbered 



in ascending order of size e (Pi) in the rest of this paper. Figure [4] 
presents a pattern covering graph. Each node m € U is connected 
to its counterpart Vi £ V by an edge with Wi,i = 1, and Pi appears 
3 times in Pg. 

It is not a good idea for PBGG to superimpose arbitrarily two pat- 
terns since later it may be difficult for Graph Augmentation Phase 
to generate a graph following the degree distribution and clustering 
coefficient. Therefore, we propose the following degree distribu- 
tion (DD) condition and clustering coefficient (CC) condition to 
avoid improper overlapping of two patterns. Let Hm denote the 
user-specified vertex degree histogram of a target graph M , where 
H Af(fe) is the number of fc-degree nodes. In addition, let H-q de- 
note the vertex degree histogram of the graph G generated so farQ 

DEFINITION 2. Degree distribution (DD) condition holds when 

oo oc 

Y^H M (k)> fc' = l,2,...,oo (1) 

Later Theorem [T]manifests that the above condition ensures that 
it is possible to transform Hg-(fe) into H a/ (fc) in Graph Augmen- 
tation Phase. Notice that edge deletion is not involved in PBGG 
since the pattern including the edge will disappear. 

In addition to the degree distribution, it is important to ensure 
that the clustering coefficient of G after pattern overlapping does 
not exceed the clustering coefficient C specified by the user. After 
acquiring the degree distribution of G, the clustering coefficient 
(CC) condition is described as follow with an efficient CC estimator 

DD. 

DEFINITION 3. Clustering coefficient ( CC) condition holds when 

c > = [fr a h — = — ] 2 , 

n d 

where d, n, and v are the average degree, total number of nodes, 
and the degree variance of G, respectively. 

CC condition prevents us from generating an unacceptable num- 
ber of triangles (i.e., an important counting parameter in CC) in 
Pattern Overlapping Phase. 

3.2 Overlapping Process 

The pattern covering graph enables PBGG to superimpose two 
patterns efficiently and effectively. The time to generate a massive 
graph is efficiently reduced since subgraph isomorphism examina- 
tion of a numerous number of pattern combinations is no longer 
required. Moreover, the common subgraph overlapped by the two 
patterns is also a pattern necessary to be inserted during the graph 
generation. In other words, three patterns are successfully handled 
by superimposing two patterns. PBGG gives priority to the two 
patterns Pj and P^ covering the maximal Pi, in order to reduce 
the number of nodes generated in Pattern Overlapping Phase, so 
that Graph Augmentation Phase later can insert more nodes with 
zero degree to increase the flexibility of edge addition and gener- 
ate a graph following the requirements on the network size, degree 
distribution, and clustering coefficient. Later Section |4~T| manifests 
that PBGG is able to generate a graph with billion nodes with about 
10 minutes. 

More specifically, the overlapping process of PBGG sequentially 
examines each pattern in the pattern covering graph in descend- 
ing order, i.e., from the largest pattern P„ to the smallest one Pi. 
For each pattern Pi, SUP(Pi) pattern instances are inserted to the 
current generated graph G. For each pattern instance of Pi, two 
overlapping strategies are sequentially conducted as follows. 

3 More details will be explained in Section|4] 



3.2.1 Self overlapping 

Self overlapping superimposes a Pi instance with the other SU P(Pi) 
— 1 instances of Pi. This strategy aggregates pattern Pi with pat- 
tern size size„ (Pi) and supports SUP (Pi), by selecting the node v 
with the minimum degree and overlapping the other size n (Pi) — 1 
nodes in multiple pattern instances of Pi. More specifically, Pi is 
first inserted into G. Afterward, we try to insert a duplicated v into 
H-q and connect v to the other size n (Pi) — 1 nodes in the same 
way as node v in Pi. Since the degree of each u connected to v 
in Pi will increase after u is linked to the duplicated v, the du- 
plicated v is allowed to be inserted and connected to u when DD 
condition and CC condition are both satisfied in G. The above pro- 
cess is repeated until (1) SUP(Pi) — 1 duplicated v are inserted, 
or (2) DD or CC condition is not satisfied for any duplicated v. 
If SUP(Pi) — 1 duplicated v are successfully inserted, the ag- 
gregated graph for the SUP (Pi) pattern instances only includes 
SUP(Pi) + size n (Pi) - 1 nodes. 

3.2.2 Cross overlapping 

For each pattern instance of Pi, cross overlapping first finds the 
pattern Pj with the largest common pattern Pk (i.e., Pi and Pj 
both connect to Pk in pattern overlapping graph Gp) to increase 
the number of overlapping nodes, where Pj has been processed 
before, i.e., size e (Pj) > size e (Pi). The pattern instance of Pi 
then randomly finds an instance of Pj such that superimposing the 
two instances with Pk follows both DD and CC conditions for G. 
PBGG will choose another pattern Pji in descending order of the 
common pattern size when cross overlapping in all instance of Pj 
is not successful. 

Pattern Pk appears in Pi and Pj multiple times when u>i,k > 1 
and Wj t k > 1, and an instance of Pk in Pi may overlap another 
instance of Pk in Pi. In other words, the self overlapping of the 
w it k and Wi t k instances in Pi and Pj may lead to different graph 
structures, preventing us from directly superimposing Pi and Pj 
with multiple Pk instances. The reason is that finding the com- 
mon graph structure (containing multiple Pk instances with differ- 
ent overlapping) from Pi and Pj requires computation intensive 
subgraph isomorphism examination. Therefore, to efficiently gen- 
erate a massive graph in reasonable time, PBGG overlaps Pi and 
Pj with only one Pk instance. It is always possible to find a com- 
mon pattern for Pi and Pj because an edge is always a pattern P e 
connecting to every other pattern in Gp. 

3.2.3 Discussion 

PBGG updates the support of a small pattern Pi after process- 
ing an instance of a large pattern Pj covering Pi. It is incorrect 
to directly reduce the support SUP(Pi) by Wjj after an instance 
of Pj is processed, because the Pj instance may overlap other ex- 
isting nodes in G. Therefore, only the pattern instances of Pi not 
appearing in G are involved in the update of the support SUP (Pi) 
for PBGG. 

It is worth noting that there exist other possibilities to super- 
impose the patterns in the above self overlapping and cross over- 
lapping strategies. For self overlapping, PBGG can select another 
node with a larger degree to substitute v when DD or CC condition 
is not satisfied. For cross overlapping, in addition to the pattern 
Pj with the largest common pattern Pk, it is also possible to si- 
multaneously superimpose Pi and other patterns with smaller com- 
mon patterns. Nevertheless, the above strategies are not adopted 
in PBGG because they are inclined to explore numerous combina- 
tions with the necessity to examine the corresponding CC and DD 
conditions. We have tried to implement those strategies, but unfor- 
tunately they deteriorate the efficiency to generate a massive graph 
in reasonable time. Due to space constraint, please find the pseudo 
codes of Pattern Overlapping Phase at [22]. 



4. GRAPH AUGMENTATION 

It has been unveiled in many real-world graphs that the degree 
distribution follows a power-law distribution Q3J ||4J , in which the 
degree histogram HM(k) of degree k is proportional to fc~ 7 for 
some parameter 7 independent of the scale of the network. New- 
man et al. [ 17 1 study the problem of generating a random graph 
with an arbitrary degree distribution. The existing graph generators 
construct a random graph from an empty graph without any edge. 
In contrast, it is necessary for Graph Augmentation Phase in PBGG 
to start from a graph G. 

When Pattern Overlapping Phase generates a concise basic graph 

G including all patterns with the specified supports, additional nodes 
are attached to G in this phase to satisfy the specified network size. 
The degree of each node in G is first adjusted in Seciion l4~Tl to fol- 
low the required degree distribution, and edges are finally added 
in Section l4~2l to achieve the target cluster coefficient. Similar to 
the existing statistical graph generators, PBGG may not be able 
to achieve the exact statistical parameters when the parameters are 
improperly specified by the user. Nevertheless, the experimental 
results in Section [5] manifest that the differences of the target pa- 
rameters and measured ones are very close in most cases. Due to 
space constraint, please find the pseudo codes of Pattern Overlap- 
ping Phase at 1221 . 

4.1 Degree Distribution 

Histogram matching is a traditional technique for distribution 
transformation. Recall that Hm is the degree histogram of a tar- 
get graph M to be created by PBGG, and let G here represent the 
graph generated from Pattern Overlapping Phase, attached by addi- 
tional nodes with zero degree to achieve the specified node number. 
Given the degree histogram H-q of graph G and a degree histogram 
H m of a target graph M, histogram matching derives a transfor- 
mation function T-q_ >m to find the new degree for each node in 

G, 

Tc_ >M (x) = C M 1 [Ca(x)], (2) 

where C-q and Cm are the cumulative histograms of H-q and Hm, 
respectively, 

X 

C(x)=Y,H(k). (3) 

fc=i 

Intuitively, C-q(x) transforms distribution H-q into the uniform dis- 
tribution, while the inverse function G M then transforms the uni- 
form distribution into Hm. However, the transformation may fail 
when k is only allowed to be discrete (i.e., k here represents the 
degree of the nodes in a graph). For instance, if the number of 1- 
degree nodes of G, i.e., H-q(\), is four times larger than Hm(1), 
the distribution transformation function Tq_ >m can only change 
Hq(1) to zero or remain unchanged and thus may be different from 
H M (1). 

By contrast, DD condition in Section 13.11 ensures that the to- 
tal number of nodes with the degrees larger than any k in Hm is 
always no smaller than the corresponding one in H-q. Therefore, 
Graph Augmentation Phase is able to transform the degree distribu- 
tion from H-q to H m by adding edges in most cases. Edge deletion 
is not incorporated in PBGG because it undermines the patterns in 
G constructed in Pattern Overlapping Phase. 

More specifically, Graph Augmentation Phase exploits the fol- 
lowing difference histogram Hd(k) for distribution transformation, 

H d (k) = H-Q-(k) - H M (k). 

According to DD condition, 

00 00 
J2HM(k)>J2Ha(k), 

k=2 k=2 



(4) 



implying that Hm(X) ^ Therefore, Graph Augmenta- 

tion Phase randomly selects -ffd(l) nodes with degree 1 from G, 
updates their degree to 2, and increases the difference histogram 
H d (2) by H d {\), so that i%(l) = H M (1). Graph Augmenta- 
tion Phase iteratively repeats the above step in ascending order of 
each degree ft. The following theorem manifests that Hd(k) is non- 
negative for all k, and this phase is always able to find Hd (ft) nodes 
for each degree k to transform H(j(k) to i?M(fc). 

THEOREM 1. The difference histogram Hd can transform the 
degree distribution H-q to the target distribution Hm- 

PROOF. As proved in Equation |4] H M (1) < Hq(1). After 
modifying H-q(1) — Hm(1) 1 -degree nodes to 2-degree, H-q(1) 
is equal to Hm(1). Using degree distribution constraint again, 



MaxDeg(H M ) 



MaxDeg(H-g-) 



n- H M (k)<n- H ai k ) 

k=3 k=3 

H M (1) + H M {2) < Ha{l) + i%(2), 

H M (2) < Ha{l) - %(1) + i%(2), 

which implies that we can transform H-Q-i2) to Hm(2). By in- 
duction, the above transformation can be achieved for other larger 
degrees. □ 

Similar to graph anonymization [23|[28|, achieving the target de- 
grees of the two terminal nodes of an edge with edge addition is 
not guaranteed to be successful. Experimental results in the next 
section manifest that the transformed distributions are very close to 
Hm in most cases, the same as the existing statistical graph gener- 
ators. 

4.2 Clustering Coefficient 

After adjusting the degree of each node in G, Graph Augmenta- 
tion Phase adds edges to the graph to achieve clustering coefficient. 
In this paper, local clustering coefficient c; of each node vt in G, 
is examined and adjusted so that the average local clustering coef- 
ficient C-q = = e jy Ci, can iteratively approach the target clus- 
tering coefficient G specified by the user, where n is the number of 
nodes in G. 



DEFINITION 4. Local clustering coefficient Ci of node Vi is 

2\e jk : Vj,v k G Ni,e jk G E\ 



fez ( ki 1 ) 



(5) 



where iVj is the set of neighboring nodes ofvi, and ki is the degree 
ofv, in~G = iV,E). 

Intuitively, adding an edge to any two nodes is inclined to sig- 
nificantly increase the clustering coefficient if the two nodes share 
many common friends because more triangles will appear and con- 
tribute to the increment of Ci in the numerator of Eq. [5] More 
specifically, assume that Vi and Vj share many common friends v k 
but are not connected. Therefore, all c.j k do not contribute to the nu- 
merator of Eq. |5]but will appear after we add an edge to Vi and Vj . 
Nevertheless, the strategy is computation-intensive and intractable 
for a massive graph since it requires Sl(n 2 ) time to examine every 
two nodes Vi and Vj at each iteration. 

By contrast, we first find the second derivative of d on ki, 

d 2 2\e ]k : Vj,v k G Nj,e jk G E\ 
9ft? fci(fci - 1) 

6fc? - 6h + 2 



Since a is monotonically decreasing with ki, the second derivative 
of d is positive, and adding edges to the nodes with smaller de- 
grees can create a larger increment on clustering coefficient. There- 
fore, adjusting low-degree nodes is much more efficient than high- 
degree nodes. 

More specifically, we examine each node in ascending order 
of the degree in G. Let C-q denote the clustering coefficient of 
graph G and C'd denote the difference between C-q and G, i.e., 
Cd = G — C-q. (1) When Cd is positive, the clustering coefficient 
c u of a node u needs to increase when transforming its degree from 
ft — 1 to k. In this case, it is preferred connecting it to another 
node v that is a neighbor of u's neighbor, and v has the smallest 
degree. We choose a neighbor of u's neighbor because adding an 
edge to connect u and v will increase the numerator (i.e., number 
of triangles) of Eq. [5] for both c u and c v , while a small degree 
on v will create a larger increment of c v simultaneously. (2) By 
contrast, when Cd is negative, c u is required to decrease. Node it 
will be connected to another node v, which is not a neighbor of it's 
neighbor, and v has the smallest degree. It is inclined that graph 
G includes many candidates with the same smallest degree (since 
many nodes may share the same degree in G), and we randomly 
choose one. Here v cannot be the neighbor of u's neighbor to avoid 
increasing the numerator of Eq. |5]for both c u and c v , while a small 
degree on v will lead to a larger reduction of the clustering coeffi- 
cient accordingly. Moreover, when a node needs to transform the 
degree from k' < k — 1 to ft, the above process will be repeated. 

Special attention is paid to transform a node u with zero-degree 
to other larger degrees because in this case u does not have any 
neighbor. It is worth noting that it is impossible to increase c u 
because c u is always when the degree of it is or 1. Therefore, 
here we focus on c v of node v only. The strategy here for it with 
zero degree is different from the above one when Cd is positive. 
Because u does not have any neighbor, it is impossible to increase 
c v , and connecting it to any node v always reduces c v . Therefore, 
it is important here to minimize the decrement of c v by choosing 
a node v with the largest degree. In contrast, similar to the above 
strategy for a negative Cd, we select a node v with the smallest 
degree to maximize the reduction of c v . The following theorem 
proves that Cd of the final graph is bounded if the user does not 
specify an improperly high clustering coefficient G. 

THEOREM 2. If the clustering coefficient C-q in Graph Aug- 
mentation Phase passes the target clustering coefficient C after in- 
serting an edge at any iteration, the clustering coefficient Cq of the 

< C G < C+ feaaa, 



kfiki - l)^ 



2\e jk : v d ,v k G N it e jh G E\ > 0. 



output graph G is bounded by C — jj, q-pj 

where k max is the maximum degree of histogram Hm- 

PROOF. When Graph Augumentation Phase adds an edge to 
graph G, the location of the inserted edge relies on the current dif- 
ference Cd between G and C-q. If C d is positive, an edge will 
be inserted to increase the clustering coefficient C-q until C-q ex- 
ceeds G (i.e., Cd becomes negative). Afterward, an edge will be 
inserted to reduce the clustering coefficient C-q until C-q is below 
G (i.e., Cd becomes positive again). The above process is repeated 
in Graph Augmentation Phase, and we prove that the range of os- 
cillation is bounded. 

This phase begins from a node with the smallest degree. If the 
difference Cd is positive, the clustering coefficient C-q needs to be 
increased, and we connect Vi via its neighbor to another node Vj 
(i.e., Vi and Vj share a common neighbor) with a larger degree. Let 
Cj denote the local clustering coefficient of t>i after inserting this 
edge, and TRIivi) denotes the number of existing triangles con- 
taining Vi. Let ki denote the vertex degree of node Wj. Notice that 
the number of new triangles created by connecting Vi and Vj is at 
most ki, where each new triangle involves only Vi, Vj , and a com- 
mon neighbor. We first derive the upper bound on the increment of 



the local clustering coefficient for Vi, 

2(h + TRIjvj)) 2(TRI(vj)) 

c% Cl ~ (ki + l)ki h(h-l) 

. 2(ki+TRI(vi)) 2(TRI{v i )) 
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(ki + l)ki 
2ki 



{h + l)ki 



~ (ki + l)ki ~ (ki + 1) 

Similarly, the upper bound on the increment of the local clus- 
tering coefficient for Vj is also nsrqrn ■ Therefore, the increment 



of Gq from Vi and Vj is bounded by- 



Moreover, thanks to 



n(& 4 +l) ' 

the new edge connecting Vi and Vj , the overall increment from the 
clustering coefficients of all common neighbors of Vi and Vj is at 
most . Therefore, the increment of Gq after inserting a new edge 



is at most 



„(ki+i) ~ rt- Because C d is positive (i.e., Cq < C 
before inserting a new edge), C-q < C+ ^ will hold after inserting 
a new edge. 

On the other hand, if Cd is negative, the clustering coefficient 
needs to be reduced, and we connect Vi to another node Vj that 
does not share a common neighbor with Vi, Since no triangle will 
be generated after inserting an edge connecting Vi and Vj , the upper 
bound on the reduction of the clustering coefficient for Vi is 

2(TRI(vi)) 2TRI(vi) 



(ki -\- l)/ci hi (hi 
—A{TRI(vi)) 

(h - i)ki(kn + iy 

SmceTRI(vi) < (h - l)h/2, 

J „ ^ -i(TRI(vi)) 



~ {ki-l)ki{ki + l) 
-2 
(h + 1)' 

Because Cd is negative (i.e., Cq > C before inserting a new edge), 
C-q > C — (fc.+i) wl 'l hold after inserting a new edge. Therefore, 



(* 

the theorem follows when ki becomes k„ 



□ 



It's worth noting that when a user specifies improper statistical 
parameters, PBGG may fail to generate a graph satisfying the pa- 
rameters. However, by relaxing DD constraint in Pattern Overlap- 
ping Phase, PBGG can still reduce the difference between Hm and 
H-q by Graph Augmentation Phase described in this section. Figure 
1 1 1 Ishows that even with improper parameters, PBGG still generates 
graphs with the clustering coefficient and degree distribution very 
close to the specified parameters. 

Complexity analysis. For self overlapping in Pattern Overlap- 
ping Phase, let k denote the minimum degree in Pi, we need to con- 
nect k edges to insert Pi. Since k — 0(size n (Pi)), inserting Pi 
takes 0(size n (Pi)) time. Extracting the node v with the minimum 
degree and inserting v into G both take 0(size n (Pi)) time. Con- 
necting v to the other size n (Pi) — 1 nodes requires 0(size n (Pi)) 
time. Moreover, 0(size n (Pi)) and 0(1) time are involved to ex- 
amine DD and CC conditions, respectively. Therefore, self over- 
lapping takes 0(size n (Pi)) time. In cross overlapping, for each 
pattern Pi, finding the pattern Pj with the largest common pattern 
Pk takes 0(np) time since we need to examine at most np edges 
on the pattern covering graph. Finding an instance of Pj such that 
superimposingjhe two instances with Pk follows both DD and CC 
conditions for G takes 0(np ■ size n (Pi)) time. Since there are np 
patterns, cross overlapping takes 0(n P ■ size n (Pi)) time. Both self 
overlapping and cross overlapping are performed np ■ SUP (Pi) 
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Figure 5: Percentage of Preserved Frequent Patterns 

times in this phase, and Pattern Overlapping Phase thereby takes 



0(np ■ SUP(Pi) 



1 (P i )) time. 



In Graph Augmentation Phase, for degree distribution, let k de- 
note the maximum degree in G, PBGG performs k iterations. In 
each iteration, it randomly selects Hd(k) nodes with degree k, 
which takes O(l) time since we can store nodes in buckets based 
on their degree in advance. Therefore, it takes 0(k) time. For 

clustering coefficient, it takes 0(size n (G) ■ k ) time to compute 
the clustering coefficient of each node of each Pi. Then, PBGG 
examines _each node in G in ascending order of the degree with 
0(size n (G)) time. To perform degree transformation, selecting 
a node v for each node u to insert an edge is repeated at most 
k times, and each one requires 0(size n (G)) time. Therefore, it 

takes 0(k ■ size n (G)) time for edge addition to achieve the tar- 
get clustering coefficient. The overall time complexity of PBGG is 

thus 0(np ■ SUP(Pi) ■ size n (Pi) + k ■ size„(G)), where k now 
is the maximum degree of G. 

5. EXPERIMENTAL RESULTS 

5.1 Experimental Setup 

Two real datasets are adopted in the experiments to generate 
billion-node graphs. The first dataset is crawled from Facebook 
with 90, 269 users in the New Orleans networlQ with the average 
degree as 26.26. The second dataset is DBLP with 317, 080 nodes, 
1, 049, 866 edges, and the average clustering coefficient is 0.7321. 
All algorithms are implemented in an HP DL580 server with four 
Intel Xeon E7-8870 2.4 GHz CPUs and 768 GB RAM, and the 
patterns of real datasets are obtained from a graph mining algo- 
rithm |5 |. For fair comparison, we choose two popular statistical 
graph generators ERM [ 1] [ 7 1 and LSM [ 2 1| with released packages 
ITlllll . ERM is a simple graph generator to preserve clustering 
coefficient in Poisson degree distribution, and LSM is a more com- 
plicated generator that can achieve both the degree distribution and 
clustering coefficient. The result is averaged over 50 times. 

5.2 Comparison of Real Datasets and Gener- 
ated Graphs 

In the following, we first compare the percentages of frequent 
patterns preserved in ERM, LSM, and PBGG in different real datasets, 
where the node number, degree distribution, and clustering coeffi- 
cient in the generated graphs follow each corresponding real dataset. 
The bit string size of the node preference in LSM is 10. Figure[5fa) 
first presents the percentages of frequent patterns preserved in dif- 
ferent generators on DBLP datasejj. The percentage of PBGG is 
100% since PBGG inserts all patterns with the corresponding sup- 
port into the graph in the first step to ensure that patterns are not 
missing during the generation of graph. As shown in Figure |5} a), 
the percentage of ERM is almost because nodes are not able to be 
systematically connected to form large patterns. Moreover, LSM 



http://socialnetworks.mpi-sws.org/data-wosn2009.html 
5 The percentages over different pattern sizes are shown in Fig. [TJ 
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Figure 7: Comparison of Clustering Coefficient and Running 
Time 

drops to zero as the pattern size approaches 6. Figure|5lb) presents 
the percentages of frequent patterns preserved in Facebook dataset. 
The trend is similar, but the percentage of LSM in Facebook is 
slightly lower than the one in DBLP since the patterns obtained 
from the graph mining algorithm in Facebook are more compli- 
cated. 

Figure |6j a) shows the real degree distribution in DBLP dataset, 
and the degree distribution of DBLP is inserted into PBGG and 
LSM (i.e., ERM can only generate Poisson distribution) for graph 
generation. We compare the real degree distribution and the dis- 
tributions of the generated graphs from ERM, LSM, and PBGG. 
The result manifests that the real distribution and the distribution 
of PBGG are very close. The distribution of LSM slightly deviates 
from the real distribution in small degrees because it is not able 
to insert a degree histogram to LSM, and therefore we choose the 
closest power-law degree distribution for it. In contrast, we can 
only control ERM by the average degree, and thus the distribution 
is very different from the others. Figure |6}b) displays the degree 
distributions of Facebook dataset. The trend of distributions is sim- 
ilar to Figure |6ja). The peaks of the distributions for ERM vary in 
Figure|6la) and Figure|6jb) because the average degrees in the two 
real datasets are different, i.e. 8.3208 in DBLP dataset and 26.2589 
in Facebook dataset. 

FigurelTJa) compares the real clustering coefficient and the clus- 
tering coefficient of the generated graphs from ERM, LSM, and 
PBGG. The result demonstrates that ERM is the closest one (al- 
most error) because edge creation probability p is directly derived 
from the clustering coefficient (20. However, by setting the edge 
probability according to the clustering coefficient, the average de- 
gree will become (n — l)p\ 1 1|7|, such that the degree distribution 
cannot follow the target distribution, as shown in Figure [6] Mean- 
while, the clustering coefficients of LSM and PBGG are also close 
to the real one. 

5.3 Efficiency Analysis 

Figure|7Jb) compares the running time of ERM, LSM, and PBGG 
with different node numbers n, where the degree distribution is 
power-law with 7 = 1.7, and the clustering coefficient is 0.73. 
Here 40 patterns are extracted from DBLP dataset as the input for 
PBGG, and the support is set as 0.02n. PBGG outperforms the 
others by orders. Although ERM simply determines the edges be- 
tween any node pairs according to a connection probability p, its 
running time grows exponentially with n due to high computation 
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Figure 9: Comparison of Running Time with Different 7 



complexity 0(n 2 ). LSM is the slowest because it needs to gen- 
erate node preference bit string first and then connect edges in ac- 
cordance with the distance of the bit string. In contrast, PBGG is 
able to generate a graph with much smaller time because PBGG is 
allowed to efficiently leverage the structures in the patterns. 

Figure[8]presents the sensitivity tests on PBGG by comparing the 
running time with different supports. The vertex degree follows the 
power-law distribution with 7 set as 1.7. The graph sizes of Figure 
(8}a) and (b) are 10 7 and 10 , respectively. The results indicate that 
the running time decreases with a larger support (i.e., more pattern 
instances are inserted), implying that Pattern Overlapping Phase 
is able to insert nodes and edges faster than Graph Augmentation 
Phase. Graph Augmentation Phase requires more time because it is 
necessary to process each edge individually. 

Figure [9] further compares the running time with different 7, 
where the support is 0.02n. The graph sizes of Figure |9ja) and 
(b) are 10 7 and 10 9 , respectively. As 7 increases, a generated 
graph is allowed to have fewer nodes with large degrees. It thus 
becomes more difficult for DD and CC conditions in Pattern Over- 
lapping Phase to hold, and PBGG needs to try more instances to 
superimpose the patterns. As C increases, Figure [To] shows that 
PBGG needs slightly more time to generate a graph following the 
desired clustering coefficients, since Graph Augmentation Phase is 
required to inserted more edges that can generate the most number 
of triangles (i.e., more cases with d > 0). In contrast, it is simpler 
for this phase to insert an edge when Cd < 0. 

Let G denote the output graph of PBGG. Figure [TTT a) compares 
the output clustering coefficient Cg of G and the target C, where 
7 is 1.7, the large support is 500,000, and the small support is 
50, 000. When the target support increases, the output CC will 
slightly deviate from the target one because CC and DD conditions 
become more difficult to be satisfied. It is worth noting that LSM 
is able to generate a graph with the size identical DBLP, accord- 
ing the variable distribution [21] learnt from DBLP. Nevertheless, 
the variable distribution may not fit the one required for generat- 
ing a larger graph (unless there is a real large graph available for 
analysis). Therefore, the output clustering coefficient of LSM also 
slightly deviates from the target one. Figure [TTT b) compares the 
target distribution and the output one, where the graph size is 10 7 
and the support is 100, 000. The results manifest that when 7 in- 
creases, the output distribution is slightly different from the target 
one because PBGG is allowed to generate fewer high-degree nodes. 
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Figure 10: Comparison of Running Time with Different Clus- 
tering Coefficients 
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rameters 

6. CONCLUSION AND FUTURE WORK 

Current graph generators can only create the graphs following 
the desirable statistical parameters. Observing that frequent pat- 
terns have been widely recognized as important graph characteris- 
tics, we proposed a pattern based graph generator (PBGG) to gen- 
erate a large single unlabeled graph with the target node number, 
degree distribution, and clustering coefficient, and the generated 
graph is guaranteed to contain the frequent patterns with the re- 
quired supports specified by the user. PBGG contains two phases: 
Pattern Overlapping Phase and Graph Augmentation Phase. Exper- 
imental results manifest that PBGG is efficient and able to generate 
a billion-node graph with about 10 minutes, and PBGG is released 
for free download. 

Similar to the existing statistical graph generators, PBGG some- 
times may not be able to achieve the exact statistical parameters 
when the parameters are improperly specified by the users. In this 
case, PBGG will generate a graph including all patterns with the 
required support and try to approach the target statistical parame- 
ters. One of our future work is to derive the supported ranges of 
statistical parameters, given the required patterns to be included. 
The ranges can prevent a user from entering improper statistical 
parameters after pre-processing the input patterns. 

It is expected that a massive graph usually has more different 
kinds of frequent patterns than a smaller graph, given the same 
support. Therefore, a massive graph generated from PBGG may 
contain other frequent patterns not specified by the user. It is un- 
realistic for a graph generator to restrict that a generated graph can 
only contain a set of given frequent patterns because it will severely 
undermine the graph generation process to achieve the required sta- 
tistical parameters. Nevertheless, it is reasonable for a user to spec- 
ify a black list of frequent patterns that are not allowed to appear in 
a generated graph. Another way is to limit the number of unspec- 
ified frequent patterns generated in a graph. Our future work will 
explore the issue of undesirable patterns for PBGG. 
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Algorithm 1 PBGC 

Input: Pattern set P={Pi,Pi,...,P„ p }, pattern covering graph Gp 
= (U,V,Ep), graph size n, clustering coefficient G, and degree 
distribution Hm 

Output: The random graph G satisfying all the conditions {Over- 
lapping process} 
1: for i = n P to 1 do 



2: if i — np then 

3: for j = 1 to SUP{P r ) do 

4: if If CC and DD conditions are satisfied then 

5: Put one Pi into graph G by self overlapping 

6: else 

7: Put one Pi into graph G separately 

8: Update SUP(P k ) if e i>k <E P P 

9: Incrementally update local clustering coefficient and 
histogram H-q 

10: else 

11: if SUP(Pi) ^0 then 

12: for k = np to i do 

13: form = itoldo 

14: if e k ,m G E P n e i>m £ Pp then 

15: Overlap Pi with Pfc by P m 

16: Update SUP{P k ) if e ijfc G Pp 

17: Incrementally update local clustering coeffi- 
cient histogram Hq 

18: break 



{Degree Transformation} 
19: for k = to MAX_DEGREE do 
20: P d (fc) = H-a(k) - H M (k); 
21: for k = to MAX_DEGREE do 

22: Random select H d (k) fe-degree nodes to Pd(fc + 1) and 

update PT d (fc + 1) 
23: Record the number of k! -degree nodes moved to k + 1 as 

N(k + 1, k'), where k'=l,...,k 
24: Cd = C — C-q\ {Edge connection with clustering coefficient} 
25: for k = 1 to MAX_DEGREE do 
26: for all j do 



27: while JV(fc, j) # do 
28: Select j-degree m 

29: ifC* d >Othen 
30: if j = fe - 1 then 

31: Connect to node v, where deg(v) is maximum 

32: else 

33: Connect to k — j nodes v, where u G iV(u) (~l 

deg(v) is minimum 

34: else 

35: Connect to node v, where w ^ JV(w)(~l deg(v) is 

minimum 
36: Update C d 



37: Output G 



